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ABSTRACT 

Published six times a year, the newsletter keeps 
educators abreast of assessment studies; forthcoming reports; staff 
announcements, meetings, and services rendered; notes of interest; 
and publications. The newsletter allows for dissemination of current 
information of the National Assessment which provides data to Tieasure 
student knowledge, skills and understandings in ten subject-matter 
areas. The lead article provides findings from a recent report 
entitled "Reading Rate and Comprehension" which showed that there are 
few rapid readers with good comprehension; dnd, there is a pattern- of 
slow readers with poor comprehension. Other articles preview a 
literature report assessing literary understanding to be released in 
December, 1972; describe the National Assessment Exercise Development 
Department; and reflect on the revised citizenship objectives for the 
1973 assessment. Brief information is included on contract bids 
awarded for 1974, and an announcement of the Social Science Education 
consortium plans for an interpretative report of citizenship goals 
data. Lastly, publications available through the NAEP office are 
listed, Tho.3e interested in receiving the free newsletter should get 
on the mailing list, A related document is ED 050 996. (SJM) 
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Reading Rate/Comprehension Report 
Squelches Myth of Super-Readers 



Most Americans read from 100 to 299 
words per minute and at those rates com- 
prehend sufficiently to answer correctly 
four or five questions about the passage 
they have read. Rapid readers— people 
reading more than 750 words per minute 
with consistently good comprehension- 
were nowhere in evidence in this study. 
Slow readers— those reading fewer than 
50 words per minute and demonstrating 
poor com prehension— were more 
frequent. 

This information Is part of a Reading 
theme report, Reading Rate andCompre- 
hension, which gives rate and comprehen- 
sion percentages for each exercise at four 
age leveL by region, sex, race, parental 
education, and size and type of com- 
munity. 

Each age level read two passoQes and 
answered five multiple-choice comprehen- 
sion questions about each passage. Nine- 
year-olds read one narrative passage 
about a boy and a dragon and an exposi- 
tory es£jy on armadillos. Thirteen-year- 
olds had two expository essays to read. 
One was a magazine essay on planting 
trees on sand dunes. The second was a 
scientific article on physical geology, spe- 
cifically the flow of water. Seventeen- 
year-olds and young adults read one 
humorous semiscientlfic magazine essay 
about avoiding mosquito bites and a more 
difficult, straightforward essay on the na- 
ture and development of sociology. Be- 
cause the reading passages were different 
for each age level except 17-year-olds 
and young adults, the report makes no 



comparisons between age levels except 
the two older groups. 

The report presents the data for read- 
ing rate in four categories: the percent- 
age of people reading at less than 100 
wr'ds per minute, those reading between 
100 ond 199 words per minute, between 
200 and 299 words per minute, and 300 
or more words per minute. Comprehen- 
sion results are percentages of those 
answering four or more questions correctly 
and those answering three or fewer ques- 
tions successfully. 

While the results tend to show that 
Northeasterners score higher on rate and 
comprehension, girls are better readers 
than boys. Whites are generally better 
readers than Blacks, **affiuent suburban- 
ites" are faster and more competent 
reoders than people from "inner-city" 
areas, and children of parents with higher 
education are better readers, there are 
some exceptions. 

For instance, Western 9-year-olds had 
the highest comprehension percentages 
in all three rate categories above 100 
words per minute: 58 percent who read 
100 to 199 words per minute responded 
correctly to four or more questions. South- 
east 13-year-olds had t*^'^ lowest percent- 
ages in all rate anu .mprehension 
categories. However, Southeast 13-year- 
olds reading 100 to 199 and 300 or more 
words per minute hod the largest percent- 
age of correct responses. Seventeen- 
year-olds in the Northeastdid have higher 
percentages of four or more correct 
responses on the comprehension, but 




young adults from that region ranked third 
in percentage having four or more correct 
responses. 

Nine-year-old boys reading between 
100 to 299 words per minute showed a 
greater percentage than girls able to 
answer four or more questions correctly, 
ihat is, of the 2 percent of males reading 
200 to 299 words per minute, 57 percent 
had four or more correct responses. Four 
percent of the females read 200 to 299 
words per minute, but only 27 percent had 
acceptable comprehension. For 13-yecfr- 
olds, too, more females read faster than 
100 words per minute, but boys had better 
comprehension scores. 

At the 13-year-old age level, compre- 
hension scores for Blacks and Whites were 
similar in the 1 00 to 1 99 words*per-minute 
category. At more than 3C0 word*, per 
minute. Whites did much better than Biacks 
on rate o >d comprehension for the first 
passage, jut, on the second passage, the 
rates were not as far apart, and compre- 
hension scores decreased for Whites ond 
increosed substantially for Blacks. The 
second passage was considered more 
difficult. 

While comprehension within rate in- 
creased with an increase in parental 
education, i 3-year-olds reading 300 or 
more words per minute on the first » as- 
sage showed a decrease in comprehension 
as parental education increased. 

Only 17 of the 7,850 readers in this 
study read faster than 750 words per 
minute. The 17-yeor-old group contained 
the greatest number of rapid readers: 7. 
The 13-year-old group contained the least: 
1. More than half of the exceptionally 
fast readers came from the West. There 
were almost twice as many males os fe- 



males and three times as many Whites as 
Blacks, but there were more Whites than 
Blacks in the study. 

When these reading rates are com- 
bined with comprehension scores, how- 
ever, only one 9-year-old, one 13-year- 
old, one 17-year-old and two young adults 
would qualify as rapid readers and that is 
on only one passage. No one in the study 
met the criteria on both passages. 

One hundred forty-nine of the 7,850 
readers in the study read less than 50 
words per minute. 

The number of slow readers was 
evenly distributed throughout the four re- 
gions of the country among 9- and 13- 
year-olds. There were no slow readers 
among the 17-year-olds from the Central 
region; but that region had the largest 
number of slow readers among the young 
adults. There were more males than fe- 
males within each group and more Whites 
than Blacks, but, again, there were more 
Whites than Blacks in the study. 

At the 9-year-old age level, compre- 
hension results show only 8 of the 111 
slow readers answering four or more com- 
prehension qjestions on both passages 
ond for 13-year-olds only 1 of 20. No 
17-year-old or young adult slow reader 
answered four or more of the comprehen- 
sion questions on both passages. 

The largest percentages for each age 
level show: 

Fifty-four percent of the 9-year-olds 
read 100 to 199 words per minute /ith 
81 percent able to answer four or more 
questions correctly on the first passage. 

Fift/-nine percent of the 13-y«»ar-olds 
read IC / to 199 words per minute on the 
second passage, but more 13-year-olds 



reading 200 to 299 words per minute were 
able to answer four or more questions 
correctly on the first passage*. 

Half of the 17-year-olds read 100 to 

199 words per minute on passage one, 
but more 17-year-olds reading 200 to 299 
words per minute were able to answer 
fou' or more questions correctly on the 
same passage. 

Most young adults read 100 to 199 
words per minute on the second passage, 
but 74 percent out of 35 percent who read 

200 to 299 words per minute on the first 
passage were able to answer four or more 
questions. 



NAEP on Screen 

The NAEP slide/fope show geared 
to genera/ audiences introduces foc' 
uhy, principals, supervisors, adm/n/s- 
frafors, students, and parents to 
Nafiona/ Assessment. The ?2-minute, 
J25-s/ide feature is avai/ab/e on loan, 
at no cost, from: 

NAEP 

Suite 300 

1860 Lincoln Street 
Denver, Colorado 80203 
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Variations on a Theme: Preview of Literature Report 



Do most people recognize puns? How 
well con they express their ideas about 
literature they have read? How familiar 
are they with literary figures like Cupid, 
Samson, or Tom Sawyer? How oi'ten and 
how much do they read? 

The literary assessment results, to be 
released next month, give some answers 
to these questions. 

The results will be presented in four 
theme volumes: Undersfand/ng /mag/no- 
five Language, Responding to Literature, 
Recognizing Literary Warfes and Charac- 
ters, and a Survey of Reading Habits. 
While only certain exercises were selected 
for reportmg, the overall results far each 
category o^ exercises are given in a sum- 
mary. The intent of these exercises was 
to assess to what degree people recognize 
what the language of literature is doing. 

The first theme deals with particular 
elements of literature: rhythm and mean- 
ing in poetry, puns, literary forms, meta- 
phors, and mood and tone. 

Exercises dealing with rneaning and 
rhythm in poetry were made up of poems 
missing one or two lines. The respondent 
was asked to complete the poem from a 
given selection of lines. He might be re* 
quired to base his decision on rhythm, or 
he may be required to complete the mean- 
ing of the poem. 

The exercises on puns gave the respon- 
dent several passages, some contGining 
puns end others not, from which he was 
to identify the puns. More then assessing 
puns, these exercises indicate to some 
degree the respondents' abilities to recog- 
nize purposeful arrbiguity in liteiature. 

Other exercises aimed at assessing 
literary understanding asked respondents 
to recognize the different literary farms: 
poems, tetters, stories, ploys, and so on. 

Respondents were also asked to iden- 
tify the components of metaphors- or the 
two things being compared — and in some 
coses to describe the qualities which make 
the comparison legitimate. 

Exercises to determine recognition of 
mood or tone asked respondents to read 
prose passages >. poems and to select 
adjectives which best described the effects 
of the mood or tone. In some instances, 
they were asked to defend their choice of 
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adjectives. In one example of o poem 
that satirizes fox hunting, the respondent 
defended his answer, 

He weren't cheerin' em on, fhot's for suie and 
he weren't doing o very good job of describing 
He sorto felt sorry for them foxes but mostly he 
was ongry 

Scoring for the essay portions was done 
on 0 one-to-faur rating scale. 

The second report on Literature, Theme 
2, is Responding to Literature. These exer- 
cises required reading of prose passages 
and poems and reacting to what was read. 
Two types of responses were involved: 
tape recorded and essay or written. For 
scoring, the responses were separated into 
categories according to their general 
thrust. An entire essay was placed in a 
category, but each statement recorded on 
tope was placed in a category. Categories 
were based on thosa deviseJ by Alan 
Purves and Victoria Rippere in Elemcnfs 
of Writing About o Literaiy Work. Those 
categories ore: 

1. Engagement involvement responses 
that include oil remarks of a personal 
nature, those in which the responcJcnt 
talked about himself or his own values 
and did not separate himself from the 
literary work. 

2. Formolistic responses that involve 
discussion of meter, characterization, 
structure, and so on. 

3. Interpretive responses that seek to 
interpret the work. 

4. Evaluative responses that judge the 
work according to some criterion. 

5. Retelling responses that simply re. 
state the passage. 

An example of an engagement involve- 
ment response is the following reaction 
to "Sam Bongs and Moonshine": 

It wos pretty good I tike it becousc my httle 
Sister IS olwoys telling mom thot when she grows 
up she IS goin^ to be o dog 

After being placed in a category, the re- 
sponses were scored on a scale of one to 
four. 

Theme 3 is mode up of exercises which 
asked the respondents to recognize a liter- 
ary work or character. Some of the exer- 



cises presented illustrations and asked the 
respondent to identify the work being 
depicted. One respondent identified Little 
.^ed Riding Hood as Little Red Muffin. 
Other exercises gave parodies of literary 
works to be identified. Allusion was used 
in exercises for character recognition. Still 
other exercises asked the respondent 
directly if he had ever heard of a char- 
acter. Some description was required 
when the answer was yes. 

The fourth theme for the Mteroture 
ossessment was a survey of all age levels 
with regard to reading habits. Respond- 
ents were asked what works they had 
been reading, how often, and why they 
read the work. Questions covered reading 
of books, magazines, drama, poetry, and 
literary criticism. 

There were also attitude questions in 
this section asking respondents such things 
as: is literature important? Should it be 
taught in every school? One respondent 
said. 

Yes, I believe we should have all the education 
we can ^lasp withm our hands these doys 

Of particular interest to readers of 
this report is a solicitation for observa- 
tions and suggestions that might be help- 
ful for future Literature assessments. 

Joins NAEP 

Don Jordan recently joined the NAEP 
staff OS assistant to the Administrative 
Director. Mr. Jordan is working between 
the NAEP project and the Education Com- 
mission administrative services on fiscal 
matters such as budget development, 
personnel administration, and personnel 
policy. He will also work with a lawyer 
on the drafting of NAEP contracts. Beyond 
these specific things, Mr. Jordan will be 
the administrative handyman, assisting 
with the various things which go through 
the administrative offices. 

Mr. Jordan is a distinguished graduate 
with honors in English from the Virginia 
Military Institute, and was listed in Who's 
Who in American Colleges and Universi- 
ties. He served as a Personnel Officer in 
the U.S. Air Force for four years before 
coming to Colorado. 
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Exercise Development 1$ Scoring Af^ain 



Anyone who has been a respondent 
for National Assessment will no doubt 
attest to the variety and originality of its 
exercises. Far a brief span of time, re- 
spo'idents may become musicians, scien- 
tists, or concerned citizens writing their 
Highway Commissioner to protest a pro- 
posed highway interchange. The aim of 
such exercises, and of the many multiple- 
choice questions that NAEP assessors 
employ, is to measure the knowledge, 
skills, and understanding of young people 
in certain subject areas; the effectiveness 
vith which they do so is due largely to 
the efforts of NAEP's Exercise Develop- 
ment Department. 

Th- work of Exercise Development 
comes 2arly in the order ot events in the 
assessment of each subjec' area. One of 
the department's major f'inctions is to 
delegate authority; specialists and edu- 
cators review and develop objectives, 
while contractors such as Educational 
Testing Services, American Institutes for 
Research, and Science Research Associates 
might write the actual exercises. Even so, 
the fourteen- member department has a 
great deal of work on its hands. Theirs is 
the task of organizing and overseeing the 
entire four-year process that precedes 
each subject area assessment. 

That process begins in the **smoke- 
filled rooms" in which department repre- 
sentatives confer with a panel of consul- 
tants. They ore there to determine what 
goals, or "objectives^" will govern the 
direction af the exercises in a given 
subject area Developed and revised by 
extensive moil reviews and conferences, 
the objectives reflect what scholars, edu- 
cators, and concerned lay people deem 
important in educational attainment; exer- 
cises ore written to determine how well 
studen.d ore achieving those objectives. 
Since different achievements ore most 
significant for different age groups, the 
objectives ore "weighted" by teachers of 
9-, 13-, and 17-year-olds and young 
adults. The more heavily on objective is 
weighted, the more assessment time will 
be devoted to exercises which measure it. 

On the basis of tho objectives and 
weightings. Exercise Development outlines 
its specifications for the contractors. 
Specifications ore refined and improved 
OS NAEP accrues experience. "Now that 
we hove some history behind us," soys 
Dr. Hal Wilson, Department Director, "we 

o 



know what we wont more explicitly. By 
being able to specify this to the contractor, 
we get better exercises." 

But even the "better exercises" ore 
not to be token for granted. They must 
come under further scrutiny at a subject 
matter review session. Again, panels of 
subject matter specialists and lay persons 
offer their criticisms as to content validity, 
appropriateness of vocabulary, the impor- 
tance of each exercise and its information, 
and passible offensiveness. To insure a 
broad spectrum of opinion, reviewers ore 
drown from a range of occupations, educa- 
tional institutions, minority groups, and 
geographical regions. 

The next step for Exercise Develop- 
ment is to test its exercises in the field. In 
0 preossessment tryout phase, the exer- 
cises ore administered to a large notional 
sample. The put pose of this pretest is to 
give some indication of how each exercise 
will probably function in the field; judg- 
ments con be mode as to its administra- 
tive feasibility, and scoring guidelines can 
be established for open-ended exercises. 
Equally crucial in the tryout phase is the 
ferreting out of "trick" questions or un- 
clear wording. 

Not all of the exercises written will 
find their way to the assessment, but 
those that ore selected will appear in sets, 
or "packages." Each package normally 
covers two subject areas, such as Reading 
and Social Studies; they are also designed 
for either individual or group administra- 
tion. The Research Triangle institute, the 
contractor which currently is preparing the 
packages, takes several factors into 
account: the difficulty lovel, the objective 
that each exercise measures, the type of 
exercise (such as multiple-choice or open- 
ended), amount of time, and types of 
stimulus (charts, graphs, music, or appara- 
tus, for example). To maintain the interest 



of the respondent, a variety of types of 
exercises ore included in each package. 

After approval by Exercise Develop- 
ment, the packages ore printed by the 
Measurement Research Center. Copy is 
p*'oofread extensively, and the topes used 
in group administered exercises ore 
thoroughly checked and rechecked. (To 
assure that o respondent on a Science 
exercise, for example, is not hampered by 
his ability to read, a standard toped voice 
presentation is used for many of the ex- 
ercises.) It has been a long and often 
meticulous process, but at lost the best 
exercises, in their best form, are ready 
for administration. 

For members of the Exercise Develop- 
ment staff, however, the work is for from 
finished. The four assistants to the direc- 
tor, who ore each responsible for two 
subject areas, ore members of a team 
(including one representative from each 
of NAEP's departments: Exercise Devel- 
opment, Operations, Research and Ana- 
lysis, Information Services, and Utilization/ 
Applications) which works on a subject 
Oreo from its inception to its completion. 
Simultaneously, the four-year Exercise 
Development process is underway in 
other subject areas. 

It is little wonder that respondents— as 
well OS all kinds of measurement special- 
ists— find Notional Assessment exercises 
remarkable; in their final form, the pack- 
ages ore interesting, challenging, and 
often even fun to complete. But the most 
remarkable aspect of National Assessment 
exercises, unknown to the respondent, is 
the many years of study, revision, and 
review that the Exercise Development 
Department has put into perfecting them. 
It is this that mokes the exercises a 
reliable method of charting the growth 
or decline of the educational attainments 
of American youth. 
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Citizenship Objectives Revised 
for 1974 Assessment 



The revised Citizenship objectives, 
which will be used in the 1974-75 assess- 
ment, have been completed by the Ameri- 
can Institutes for Research. Based on a 
consensus of opinion of severol review 
groups, the revised objectives reflect 
what educators, subject matter specialists, 
and lay people consider major gools in 
citizenship attainment today. The purpose 
of the revision is not to replace the old 
objectives, but to make whotever changes, 
additions, or deletions, were necessary to 
update them. 

Seven major objectives or goals are 
identified in the revised Citizenship ob- 
jectives. These represent such broad 
categories of citizenship achievement as 
concern for the well-being and dignity of 
others, support of just law and the rights 
of all individuals, and a knowledge of the 
main structure and functions of govern- 
ment. Under each of the major objectives 
are listed several subobjectives (such as, 
"offer help to others in need" and "rec- 
ognize the relationships of different levels 
of government") representing the major 
kinds of behavioral achievements referred 
to by the general objective. Under each 
subobjective are listed a variety of be- 
haviors which illustrate alternative ways 
in which the subobjective may be achieved 
at each of the four target age levels. 
These behaviors are not intended to be 
prescriptive definitions of good citizenship 
but rather serve as illustrotive examples. 

The major changes in the Citizenship 
objectives prepared for ttie 1974-75 
assessment are these: 

1. For some subobjectives, illustrotive 
behaviors have been added for the 9- and 
13-year-old oge level (under the sub- 
objective "support equal opportunity in 
education, housing, employment, and 
recreotion"). For example, opposition to 
segregation has been included as an illus- 
trative behavior for age 9. 

2. The description of the major civic 
problems which a citizen needs to under- 
stand in order to act effectively has been 
expanded. Most notable In this revision 
are two new categories pertaining to 
economic needs (poverty, employment, 



and so on) and environmental problems 
(such as pollution). 

3. In response to criticism that the 
objective on knowledge of government 
wos too limited to textbook ideals, illus- 
trative behaviors were added concerning 
knowledge of informal influences on gov- 
ernment, sources of actuol power, ond 
bureaucrac/ Effectiveness of citizen par- 
ticipation ra'I.er than effort alone was also 
emphasized. 

4. Objectives dealing with personal 
development and voluntary personal rela- 
tions were in many instances concluded to 
be too remotely related to citizenship to 



CteElVnotes 



Seven people from the Wyoming State 
Department of Education and the Univer- 
sity of Wyoming attended a one ond a half 
day session at the NAEP offices in Sep- 
tember to discuss the adaptability of the 
NAEP model to the Wyoming Educationol 
Needs Assessment Project. WYENAP is a 
project of the Wyoming otate Department 
and has been contracted to the University 
of Wyoming's Center for Research, Service 
and Publication. 

Members of the Utilization/Applica- 
tions Department visited with staff of the 
Americon Association of School Adminis- 
trators to discuss the possibility of that 
organization becoming involved in a study 
of the National Assessment model and 
data. The purpose of the study would be 
a document discussing application of NAEP 
data for school administrators and adapta- 
tion of the assessment model to local 
school districts. 

The same busy department sent Carol 
Byerly and Ron Smith to Fresno, Califor- 



retain. These aspects of citizenship, while 
not eliminated, received less emphasis in 
the revised objectives. 

5. The behaviors listed under a num- 
ber of the original objectives seemed to 
emphosize middle-class values which 
might not be accepted as goals by other 
social strata of the nation. In several 
instances such behoviors were deleted cr 
changed to examples with more universal 
appeal. For example, "controlling emo- 
tions in the foce of criticism" was changed 
to "express emotions in nondestructive 
ways." 

National Assessment objectives are 
not permonent stondards of achievement; 
rather, they are intended to reflect the 
evolution of gools in educotion in response 
to the chonging needs of the nation. Re- 
view of the objectives by concerned fay- 
men, scholars, and educators as a first 
step in every assessment helps to assure 
that the objectives are attuned to goals 
which the society values. 



nia in September. The two made a pre- 
sentation about the relevance of National 
Assessment to the classroom teacher to 
500 teachers and administrators of Fresno 
County. The reaction by a discussion 
panel made up of college and public 
school officiols wos positive. 

The Deportment of Educational Plan- 
ning under the Organization of American 
States is planning an ossessment of the 
quality of education throughout Ecuador. 
The deportment hos requested informa- 
tion on the NAEP project. 

Have you seen Hope Justus' report on 
Reoding in the August- September issue of 
AmencanEduco//on? Fully illustrated with 
exercises, it is another example of a care- 
fully developed article by one of the 
country's best-informed education writers. 
Hope is an education columnist for the 
Chicago Tribune. 

An interesting ortlcle on educational 
testing, specifically IQ testing, appeors in 
the September 1972 issue of Today's Edu- 
cation. Lillian Zach wrote the article en- 
titled "The IQ Debote." 

A request to users of the NAEP slide 
show: Please do not keep the materials 
ony longer than absolutely necessory. 
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SSEC 
Plans Report 



interest is growing for interpretations 
of National Assessment reports by organi- 
zations and individuals concerned with the 
subject areas being assessed. The Na- 
tional Science Teachers Association, re- 
ported in the October Newsletter, was the 
first group to begin an in-depth study of 
assessment results. 

Now under consideration are pro- 
posals by the Social Science Educotion 
Consortium, Inc. (SSEC). The SSEC plans 
an interpretive report of the Citizenship 
goals and data, drawing upon the objec- 
tives and three report volumes already 
produced by NAEP. The report will be 
written by a scholar selected for his repu- 
tation in the social sciences and, in gen- 
eral, his analytical skills and work in this 
area. He will work with two of the three 
directors of SSEC, Irving Morrissett and 
Robert Fox. 

Tentative plans for the report include 
summaries of early commissions of the 
National Education Association and the 
American Historical Association to clarify 
citizenship training, the statements of 
goals by the National Council for the 
Social Studies, and the statement of na- 
tional goals by the United States President. 

The publication of several versions of 
scholarly interpretations is planned to 
meet such needs as: increasing the num- 
ber of thoughtful Americans who are 
aware of efforts to provide baseline data 
for educational measurements; increasing 
the number of scholars who will give 
earnest consideration to improvement of 
citizenship education; encouraging the 
total citizenry to give more attention to 
the needs of citizenship education; and 
improving citizenship education in the 
social studies classroom specifically and 
in the rest of the curriculum generally. 

The SSEC is a not-for-profit corpora- 
tion founded in 1965 as a social studies/ 
social science education resource and 
dissemination center, with headquarters 
in Boulder, Colorado. The Consortium pro- 
vides for the exchange of ideas and views 
for the improvement of social studies edu-^ 
cation and provides information about 
social studies materials, methods, and 
trends to teachers and administrators. 



Contract Bids Awarded for 1974 



Preporation for the 1974 assessment 
included N^EP's competitive procurement 
of contracts in the areas of sampling, ad- 
ministration, printing, and scoring. Work 
on specifications began in February 1972 
with what Director of Operations Rogar 
Talle described as "a massive effort by 
the staff to develop specifications for the 
bidding." 

NAEP solicited interest in dding from 
250 controcting firms identified by the 
U.S. Office of Education as agencies doing 
the kinds of work needed by National 
Assessment. Those ayencies showing in- 
terest received specifications and those 
interested in submitting proposals at- 
tended a conference in Denver in May. 
The purpose of the conference was to talk 
about the proposals and answer any 
questions. 

Seven firms submitted bids in June: 
two for the in-school sampling and admin- 
istration contract, two fcr the out-of-school 
sampling and administration, and three 
for printing and scoring of exercises. 

The NAEP staff and an external review 
group studied each proposal. Basing their 
decision on the recommendations of both 
groups, NAEP selected the Research Tr= 



angle Institute (RTI) to do the in-school 
sampling and administration and the 
Measurement Research Center (MRC) to 
do the printing and scoring of exercises. 

Two excellent proposals for out-of- 
school sampling and administration made 
a decision on that contract more difficult. 
NAEP staff reviewed additional informa- 
tion on proposals and, in September, 
awarded the bid to RTI. 

RTI is a not-for-profit contract research 
organization located in Raleigh, North 
Corolina. The Institute was incorporated 
as a seporate operating entity in 1958 by 
the University of North Corolina. RTI re- 
search is performed under contract with 
government agencies, foundations, and 
industrit;s. 

Established in 1953, MRC, in Iowa 
City, is an outgrowth of the Iowa Testing 
Program. It became a division of Westing- 
house Learning Corporation in 1958. The 
firm is a pioneer in the application of 
electronic scoring machines to the test- 
scoring process and has added a variety 
of new services to education, business, 
and government. It is the largest pro- 
cessor of standardized educational tests 
in the world. 



Neili H^ads ECS Public Relations 



George W. Neill has been appointed 
Director of Public Relations and Communi- 
cations for the Education Commission of 
the States. For the past five years he has 
served as Executive 
Editor of Education, 
U.S.A., the weekly 
newsletter published 
by the National 
School Public Rela- 
tions Association 
(NSPRA), with head- 
quarters in Washing- 
ton, D.C. 

A native of California, Mr. Neill was 
graduated from the University of Califor- 
nia in Berkeley and worked as Sunday 
editor, city editor, news editor, and night 
editor of the Pasadena Independent, Star- 
News for 12 years. He was also managing 
editor of the Orange Coast Daily Pilot \n 
Colifornia and copy editor for the Los 
Angeles Times. For six years he was Direc- 
tor of Press Relations and Editor, Education 




News Service, for the Colifornia Teachers 
Association. 

During Nis Washington service with 
NSPRA, he was director of Special Reports, 
a series of booklets dealing with crucial 
issues in education today. He coauthored 
one called "The Reading Crisis" and wrote 
the first volume describing federal aid to 
education. He authored books on Black 
studies in elementary-secondary educa- 
tion, individualization in schools, and the 
year-round school. He is also a contribu- 
tor of education articlei to Better Homes 
and Gardens; an article appeared in the 
October 1972 issue. 

At ECS Mr. Neill will direct the public 
relations and public information program, 
coordinating this program not only for the 
Commission itself but also for the various 
projects administered by ECS. He suc- 
ceeds Clifford Dochterman who is now 
vice-president-executive assistant at the 
University of the Pacific in Stockton, 
California. 
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National Assess 

The following publications are available through the 
NAEP office at no charge except where price is indicated. 

OBJECTIVES BOOKLETS 

Description of objectives for each National Assessment 

subject area and the process of their development in detail. 
Order 

Number Title price 

1 0 1 Gtizenship* $ ] 00 

102 Writing KOO 

103 Science* 1.00 

104 Reading 1.00 

105 Literature 1.00 

1 06 Mathematics 1 .00 

107 Music 1.00 

1 08 SociH Studies 1 OO 

109 Art 1.00 

1 1 0 Career ond Occupational Development 1 .00 

•Revised Science ond Ciluenship Ob|ectives for Ihe second ossessmenis 
ore olso ovoilobie m booklet form. 

MONOGRAPHS 

Written accounts by former NAEP staff directors about 
the nature of the project. 
Order 

Number Title Price 

201 The National Assessment Approach to 

Exercise Development, Carnen J. Finley 

and Frances S. Berdie. July 1970 53.00 

202 What Is National Assessment? 

Frank B. Womer. April 1970 2.00 

BROCHURES 
Orde 

Number Title 

301 "Questions and Answers": A brief summary leaflet 

about National Assessment. April 1972. 

302 "Whet Are Our Kids Really Learning in Schooir' 

April 1972. 
ARTICLE REPRINTS 
Order 

Number Title 

401 "National Assessment: Where Is It NowT' 

George H. Johnson 

Reprinted from Educational Leadership, December, 
1971. 

402 "Do 13-Year-Olds Write as Well as 17- Year-Olds?' 

Henry B. Slotnick. 

Reprinted from English Journal, November, 1971. 

403 "National Assessment Says/' Frank B. Womer. 

Includes selected results from the first science as- 
sessment and the author's comments about them. 
NCME Special Report, Volume 2, No. 1, October, 
1970. 

404 "National Assessment," and "Discussion," Robert E. 

Stake and Frank B. Womer. 

Reprinted from Froceed/ngs of the 1970 Invitational 
Conference on Testing Problems^ The Promise and 
Perils of Educational Information Systems, October 
31, 1970. 



ment Publications 



405 

406 

407 

408 

409 
410 



411 



413 



414 



415 



416 



417 



418 



419 



420 



"National Assessment in Mathematics," Dale I. Fore- 
man and William A. Mehrens. 
Reprinted from The Mathematics Teacher, Volume 
LXIV, March, 1971. 

"National Assessment: An Information Gathering and 
Information Dissemination Project," Eleanor L. 
Norris. 

Reprinted from Ec/ucaf/on, April-May, 1971. 

"Notional Assessment: Reports and Implications for 
School Districts/' Carmen J. Finley. 
Reprinted from The National Elementary 
Principal, Volume L, No. 3, January, 1971. 

"National Assessment— Some Valuable By-Products 
for Schools/' Ralph W. Tyler. 
Reprinted from The National Elementary 
Principal, Volume XLVIII, No. 6, May, 1969. 

Compact, A complete issue devoted to National As- 
sessment of Educational Progress, February, 1972. 

"Public Learns What Four Ages Know in Writing and 
Gtizenship/' Includes selected results from the 
first writing and citizenship assessments and the 
reacrions of subject matter specialists. 
NAEP Newsletter, Volume IV, No. 1. January- 
February, 1971. 

"Region, Size-Of-Community, Sex Results Released 
for Science, Writing." Includes selected breakdown 
results from science and wi ting and the reactions 
of reviewers. 

NAEP Newsletter, Volume IV, No. 3, May-June, 
1971. 

"Reexamination of Multiple- Choice Testing," Frank 

B. Womer. Speech delivered at the NCME 

Breakfast, Minneapolis, Minnesota. 

Reprinted from Ec/ucaf/on, April-May, 1970. 
"Research Toward National Assessment," Frank B. 

Womer. 

Paper presented at the Western Regional Confer- 
ence on Testing Problems, May, 1968. 
"To Rile Your Community, Ask Questions Like These," 
Frances S. Berdie. 

Reprinted from American School Board Journal, 
June, 1 970. 

"What Test Questions Are Likely to Offend the Gen- 
etal Public," Frances S. Berdie. 
Reprinted from Journal of Educational Measure- 
ment, Volume 8, No. 2, Summer, 1971. 

"What We Are Learning From the National Assess- 
ment," Eleanor L. Norns. 

Reprinted from American Education, Volume 7, No. 
6, July, 1971. 

"How Will National Assessment Change American 
Education?" Frank B. Womer and Marjorie M. 
Mastie. 

Reprinted from Phi Delta Kappan, Volume 53, No. 
2, October, 1971. 
Demonstration Packages of Sample Exercises in Read- 
ing and Literature, separate packages for ages 9, 
13, and 17. 

Demonstration Packages of Sample Exercises in Music 
and Social Studies. 
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Calendar 



DATE 
October 17 

19-20 

30 

November 4 
23-24 



MEETING 

National Association of 
Stote Boards of Edu^i^' 

Coundl of Great Oty ' 
Schools 

Annual Meeting of the 
Directors of State 
Testing Programs 

Michigan Council for 

Sodal Studies 
Annual Meeting of l*4ational 

Council of Teachers 

of English 



PLACE 

Des Moines, 

Iowa 
!>enver, 

Colorodo 
Princeton, 

New jersey 

Detroit, 
Michigan 

Minneopolis, 
Minnesota 



NAEP PARTiaPANT 
Jim Hazlett 

NAEP Staff 

J. Stanley Ahmann 

Dick Hulsart 

J. Stanley Ahmonn 
Rex Brown 
Carol Byeriy 
HankSlotnidc 
Ron Smith 
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